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■ Abstract 

^ I We introduce a machine free mathematical framework to get a natural formaliza- 

' tion of some general notions of infinite computation in the context of Kolmogorov 

, complexity. Namely, the classes Max^^'^ and Max^J^ of functions X ^ P which 

\ are pointwise maximum of partial or total computable sequences of functions where 

■ T) = {D, <) is some computable partially ordered set. The enumeration theorem 
^T) . and the invariance theorem always hold for Max^'^'^, leading to a variant 

C5 \ of Kolmogorov complexity. We characterize the orders T> such that the enumera- 

I ■ tion theorem (resp. the invariance theorem) also holds for Max'^J^ . It turns out 

. that Max^^J^ may satisfy the invariance theorem but not the enumeration theo- 

\ rem. Also, when Max^J^ satisfies the invariance theorem then the Kolmogorov 

' complexities associated to Max^J^ and Max^'j^'^ are equal (up to a constant). 

•'"! ■ Letting = -f^max > where V"^^"" is the reverse order, we prove that either 

rN ; =ct i^max =ct (=ct is equality up to a constant) or K'^-^,K^^^ are <ct 

' incomparable and <ct and >ct K'^ ■ We characterize the orders leading to 

each case. We also show that K^in^ -^max cannot be both much smaller than 
at any point. 

These results are proved in a more general setting with two orders on D, one 
extending the other. 

Contents 

1 Introduction 3 

1.1 Non halting programs for which the current output is eventually the 
wanted object, but one does not know when... 3 

1.2 Functions approximable from below (resp. from above) as 
decompressors for variants of Kolmogorov complexity 4 

1.3 Main theorems 5 



Preprint submitted to Elsevier 



2 February 2008 



1.4 The Maxj^^ and Mirij^^^ classes 6 

1.5 Notations 6 

2 The Max and Min classes of functions 7 

2.1 Infinite computations and monotone machines 7 

2.2 Mathematical modelization: the Max and Min classes 8 

2.3 Domains of functions in the Max /Min classes 9 

2.4 Examples of functions in the Max and Min classes 9 

2.5 Normalized representations 13 

3 Kolmogorov complexities K^^, ^min 1^ 

3.1 Kolmogorov complexity 14 

3.2 Enumeration theorem for Max^'^^ 15 

3.3 Kolmogorov complexity and i^mm 16 

4 Main theorems: comparing K, i^^ax' ^min^ ^'^ 

4.1 The <ct hierarchy theorem 17 

4.2 (*) is an effective version of the negation of (**) 19 

4.3 iir^jjj. , i^^^^ are not simultaneously much smaller than iiT^ 20 
4-4 and the jump 21 

4.5 Proof of Theorem 4.1 (1st hierarchy theorem) 22 

4.6 Inequalities K^*, <ct K^l, and K'^^ <et 22 

4.7 If (*) holds: proof of Point 1 of Theorem 4.3 (3rd hierarchy theorem) 22 

4.8 Proof of Point 1 of Theorem 4.2 (2d hierarchy theorem) 24 

4.9 If (**) holds: proof of Point 2 of Theorem 4.3 (3d hierarchy theorem) 24 

4.10 Proof of Point 2 of Theorem 4.2 (2d hierarchy theorem) 25 

5 Complementary results about the Max and Min classes 26 

5.1 Total functions in Max^J^ and Maxf^'^ 26 

5.2 Comparing Max|^^,Max|;;^ and Pi?^-"^,i?ec^-"^ 26 

5.3 Post hierarchy and the Max/Min classes 27 

5.4 Max n Min classes 29 

6 Max^^^ and Minj^^^ and Kolmogorov complexity 30 

6.1 Max^'^^^ and the enumeration theorem 30 

6.2 Maxfg7^ and the invariance theorem 31 
References 34 



2 



1 Introduction 



1.1 Non halting programs for which the current output is eventually the 
wanted object, hut one does not know when... 

In this paper, we consider a particular kind of description methods in order to 
define variants of Kolmogorov complexity. Let's start with two paradigmatic 
examples. Given G N and u G S* (where S be some finite alphabet), how 
do we get 

- the value BB{n) of the busy beaver function BB : N ^ N, 

- the value i^s* (u) of Kolmogorov complexity Kj^* : S* — >■ N ? 

The definitions of BB{n) and Kj^*{u) lead to the following mechanisms. 

- run all Turing machines with < n states and all programs with length < n, 

- for each t, consider those machines and programs halting in < t steps, 

- look at the maximum number of cells visited by these machines, 

- look at the minimum length of these programs. 

In this way, one gets two computable functions bb : N x N N and k : 
S* X N ^ N, with one more integer argument (for time steps) such that, for 
every fixed n G N and u G S*, the maps t ^— bb{n,t) and t ^— k{u,t) are 
respectively monotone increasing and decreasing and are both eventually con- 
stant with respective values BB{n) and Kj]*{u). Since neither BB nor Kj:* 
is computable, there is no computable functions of n or m which bound the 
moment these maps become constant. 

These examples lead us to introduce the following notion of description meth- 
ods for objects of a partially ordered set V with a computable structure (cf. 
Definition [231E3D. 

A computable approximation from below (resp. from above) of objects ofD is 
a program for a computable function / : X x N — ^ P ( where X is some reason- 
able set such as N or 2* , cf. § j.5l Notations) such that, for every fixed a; G X, 
the map t ^— f{x,t) is monotone increasing (resp. decreasing) and eventually 
constant. Nothing is assumed about the moment t ^— f{x,t) becomes constant: 
there may be no computable function of x majorizing it. 

The associated decompressor — or description method — is the function F : 
X ^ P such that F[x) is the limit value of f{x, t) when t —>■ +00, i.e. the max- 
imum (resp. minimum) value of the finite set {f{x,t) : t G N}. We shall call 
such functions F computably approximable from below (resp. from above). 

Consider S* with the prefix ordering. The context of non halting (hence in- 
finite) computations, cf. Chaitin, 1975 [1], and Solovay, 1977 [IS], leads to 
functions F : 2* — S* which are computably approximable from below. In 
fact, if the output alphabet is S, the current output f{x,t) at time t is a 
function / : 2* x N — S* which is a computable approximation from below 
for words in S* such that F{x) is the max of the f{x, t)'s . 
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Observe that, in case the ordered set V is noetherian (resp. well-founded), the 
notion of approximation from below (resp. from above) of objects of T) reduces 
to that of computable function / : X x N ^ P which is monotone increas- 
ing (resp. decreasing) with respect to its second argument. This is indeed the 
case with the approximation from above of the values of K^.* since (N, <) is 
well-founded. Cf. also gHH 

Other examples are developped in §2.41 In particular, there is one involving 
quotients of regular languages by a fixed computably enumerable language. 

1.2 Functions approximable from below (resp. from above) as decompressors 
for variants of Kolmogorov complexity 

The above mentioned context of non halting computations has recently led to 
interesting variants K^^. : E* — N, : N — N of Kolmogorov complexity 
introduced (in their prefix-complexity version H°°) in Becher & Chaitin 
This last Kolmogorov complexity has also proved to be equal to the 
Kolmogorov complexity Kcard introduced in Ferbus & Grigorieff, 2002 piS] 
where we compare some natural set theoretical semantics of integers, namely 
Church iterators of functions, cardinals of computably enumerable sets, in- 
dexes of computably enumerable equivalence relations. Comparison of these 
semantics is done via associated Kolmogorov complexities which somehow 
constitute measures of their "abstraction degree" and are defined in terms of 
infinite or/and oracular computations. 

The cornerstone of Kolmogorov complexity, namely the invariance theorem, 
really deals with partial computable functions, not Turing machines. In fact, 
Turing machines do not constitute such an abstract structured mathematical 
framework as partial computable functions do. Going to this last framework 
opens new natural considerations which would not be simply viewed with Tur- 
ing machines. 

In this paper we abstract from non halting computations on Turing machines 
and develop a general machine-free mathematical framework using a partially 
ordered set T>. Namely, letting X be a basic space (cf. §1.51 Notations), we 
introduce the classes of functions F : X ^ V 

Maxf^'^ , Minf^'^ 

which are partial computably approximable from below (resp. from above). 
Which means that the / : 2* x N — > "D such that F{x) is the max or min of 
the /(x, t)'s is partial computable rather than computable. 
Of course, the Min classes are the Max classes associated to the reverse order. 
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We also introduce the subclasses of functions 



which are computably approximable from below (resp. from above). It happens 
that the Max^J^ class is closely related with the class based on non halting 
Turing machines computations with outputs in T) (modulo adequate coding 
of V). 

As for the above examples, the busy beaver function BB : N — > N is in 
Max^g^and Kolmogorov complexity K^,* : S* — > N and its prefix-free variant 
H^, : S* N are in Min^^^ with P = (N, <). 

These classes lead to new variants of Kolmogorov complexity which would just 
be ignored when considering Turing machines. 



1.3 Main theorems 



The development of Kolmogorov complexities K^^, K^-^ associated to the 
classes Max^p^^ and Minj^^'^ is straightforward (cf. The main results 
of the paper deal with the comparison of K^^^, -ft'^m with the classical Kol- 
mogorov complexity and its relativized version K®''^ to oracle 0'. In SI 
we prove three theorems which give the main comparison relations (relative 
to the "up to a constant" order <ct, cf. §1.51 Notations) between these com- 
plexities. 

The first theorem (Thm l^TTl) is valid whatever be the partial order on Z). It 
states that i^®'-^ <ct mf{K^^^,KZn) and that K^^, K^^^, though obviously 
<ct K^, cannot be simultaneously much smaller than since 

<ct {KZa. + log(i^Lj) + {KZr.. + ^Og{KZj) 

The second theorem (Thm l4l2|) proves that either K^^^ =ct -K^mm =ct K'-^ or 
K^^,KJ^^^ are <ct incomparable and both are <ct to K^. This dichotomy is 
also characterized by a simple property on the order. 

The third theorem (Thm J175i) considers two partial orders <wk and <st on D, 
the second extending the first. We give conditions (*) and (**) on the orders 
such that 

- (*) insures that K^'^ and fsT^^ =ct K^in, 

- {**) insures that <et K'^'^ and K'^'^ and neither K^'^ nor 

These conditions are almost complementary: (**) is an effective version of the 
negation of (*). 

An interesting case of this theorem is obtained when S = {1, k) with the 
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obvious order and <„fc, <st are the prefix and the lexicographic orders on S* 
(the last one being isomorphic to the order on A;-adic rational reals in [0, 1]). 

1.4 The Maxji^^ and Mirij^^^ classes 

In §5.21 and 15.31 we come back to the four classes Maxj^j^^, Mirr^j^^ and 
Max|*g^-^, Min^^^^ . We compare them to that of partial computable func- 
tions X ^ P and look at the syntactical complexity of their domains and 
graphs. 

In §5.41 we compute Max'ji](^ fl Min^^'^ under simple conditions about the 
partial order on D. 

In [ini we consider the possible development of Kolmogorov complexities based 
on the classes Max"^^^^ and Min^^~^^. This leads to look at the two following 
problems: 

- the existence of an enumeration, 

- the invariance theorem. 

For each problem, we characterize the orders V for which there is a positive 
answer (cf. 16. 2p . 

It turns out (cf. Thm J6.2|) that when the invariance theorem holds for Maxj^^^ 
then every function in Max^j^^ has an extension (not necessarily total) 
in Max]^^^. This insures that the Kolmogorov complexities associated to 
Max^g^-^ and Max^j^^ coincide. In particular, K^* is the complexity asso- 
ciated to Max^^'^ and Max'^p^^ when T) is E* with the prefix order. 
Surprisingly, there are orders such that the invariance theorem holds for Max^^^ 
whereas the enumeration theorem fails (compare Thm j6.1] and Thm J6.2]) . 

1.5 Notations 

1. Equality, inequality and strict inequality up to a constant between total 
functions § — >■ N are denoted as follows: 

f <ct g ^ 3c Vs /(s) <g{s)+c 

f =ct g ^ f<ctgAg<ctf ^ 3c Vs |/(s) - ^(s)| < c 

f <ct g ^ f <ctg A -^{g <ct f)^f<ctg a Vc 3s ^(s) > /(s) + c 

2. [Basic spaces] 2* denotes the set of binary words. We call basic spaces the 
products of non empty finite families of spaces of the form N or Z or A* where 
A is some finite alphabet. Basic spaces are denoted by S, X, Y, ... 

3. [Partial recursive (or computable) functions] PR^~*^ (resp. Rec[X Y]) 
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denotes the family of partial (resp. total) computable functions from X to Y. 



2 The Max and Min classes of functions 

2.1 Infinite computations and monotone machines 

Recall that a Turing machine is monotone if its current output may only 
increase with respect to the prefix order on words: no overwriting is allowed. 
This is indeed Turing's original assumption |20j, insuring that, in the limit 
of time, the output of a non halting computation always converges, either 
to a finite or to an infinite sequence. This concept was also considered by 
Levin [Hj and Schnorr [T61IT7] . see [15] p. 276. Such infinite computations with 
possibly infinite outputs can be used to obtain highly random reals, cf. Becher 
& Chaitin |1] and Becher & Grigorieff [3]. 

In this paper, when considering infinite computations, we retain the sole limit 
outputs that are finite. 

The following easy proposition links infinite computations, as considered for 
the definition of K°° and its prefix version H°° introduced in [2], with the 
general approach which is the subject of this paper. 

Proposition 2.1 Let F : 2* S* where S is some non empty finite alphabet. 
The following conditions are equivalent: 

i. F can be computed via possibly infinite computations on some monotone 
Turing machine with output alphabet S, according to the following con- 
vention: F{s) is defined if and only if the output remains constant after 
some step. 

a. There exists a total computable function / : 2* x N ^ S* such that 

- f{s,t) is monotone increasing in t with respect to the prefix order on 

- s e dom{F) if and only if {/(s, t) : t G N} is finite and non empty, 

- F{s) is the maximum value of {f{s,t) : t G N}. 

Hi. Let A denote the empty word. Idem as ii, with f such that 

/(s,0) = A , /(s,t + l)G{/(s,t)}U{/(s,t)a:aGS} 

PROOF. Hi =^ ii is trivial; i 4^ Hi : let /(s,t) be the current output at 
time t when the input is s. As for ii =^ Hi, let /(s,0) = A and f{s,t + 1) 
be the prefix of f{s,t + 1) with length min(|/(s,t)| + 1, |/(s,t + 1)|). Then 
{/(s,t) : t G N} and {f{s,t) : t G N} are simultaneously finite or infinite and, 
when finite, their maximum elements are equal. □ 
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2.2 Mathematical modelization: the Max and Min classes 



Proposition 12.11 and the argumentation in §1.H - |1.2I invite to a mathemati- 
cal, machine-free modehzation of the notion of function defined by infinite 
computations. Namely that of function obtained as pointwise maximum of 
a computable sequence of total computable functions. A construction which 
makes sense for maps from a basic set X into any computable partially ordered 
set V = {D, <), and leads to the class Max^J^ . 

It is also quite natural - in fact, it is even much more natural from a mathe- 
matical point of view - to consider the version of the above modelization using 
partial computable functions instead of total computable ones. This leads to 
the class Max^~^^ . 

Natural and interesting important examples (cf. §2.4p are obtained when V is 
among the following (obviously computable) partially ordered sets: 

(N, <) , (Z, <) , (S , ^prefix) ) ) ^lexico) 

and the reverse orders obtained by replacing < by >, where <iexico on E* 
depends on a total or partial order on the alphabet S. 

Definition 2.2 (The max-^ and min^^ operators) Let X be some basic set 
and T> = {D, <) be some partially ordered set. Let f : HxN D be monotone 
increasing in its second argument on its domain. We define max^f : X — D 
(resp. mm^ f : X ^ as the function 

i. defined on the x 's m X for which the map t f{x, t) has finite non empty 
range, 

a. and such that (max^ f){x) (resp. (min'^/)(x) ) is the maximum (resp. min- 
imum) element of {f{x,t) : t G N}. 

Definition 2.3 

1. A computable partially ordered set V is a triple {D, <, p) such that p : N — 
D is a bijective total map (in particular, D is infinite countable) and < is a 
partial order on D such that {(m, n) : p(m) < p{n)} is computable. 

2. Let ^ be a basic space. A function F : H ^ D is partial (resp. total) 
computable if so is p^^ o F : X ^ N. 

A set Z (1 X X is computable if so is {Idx, p, p)^^{Z) as a subset of 
X X N'^, where Idx is the identity function on X. 

Of course, we shall omit any reference to p when "D is N or Z with the natural 
order, or S* with the prefix or the lexicographic order (with respect to some 
partial or total order of the elements of S). 

Definition 2.4 {Max and Min classes) Let X be a basic space and T> = 
{D, <,p) be a computable partially ordered set. We let 
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Max^J^ = {max^ f : f : X x N ^ D is total computable} 
Max^'^ = {max^ f : f : X x N ^ D is partial computable} 

We respectively denote by Minf,]^^ and Min^^ the analog classes defined 
with the ToirJ^ operator, i.e. the classes Maxp]^-^'^"" and Max^'^^'^"" where 

jyrev ^ (^D , >) . 

Proposition 12.11 can be rephrased in terms of the prefix ordering on S*. 

Proposition 2.5 // S is a finite alphabet then Maxj^^^ ' is the class 
of functions computed via possibly infinite computations on monotone Turing 
machines (cf. Proposition \2. 1\ i) with E as output alphabet. 

2.3 Domains of functions in the Max/Min classes 

We denote by A the family of conjunctions of and formulas. Let X 
be a basic set and P be a computable ordered set. The arithmetical hierarchy 
on N induces a hierarchy on D and Xx D : a relation C X x D is S° or 11° 
or SO A no if so is (Jrfx, py\R) C X x N. 

Proposition 2.6 Let H be a basic set and V be a computable ordered set. 
Every partial function in Max^p~^^ or in Min^']^^ has A graph and T,^ 
domain. 



PROOF. Let / : X X N — > D be partial computable, monotone increasing in 
its second argument on its domain. Then 

(max'^/)(x) = z4^3t (/(x, t) is defined A /(x, t) = z) 

A Vt (/(x,t) is defined f{x,t) < z) 
X G dom{max^ f) 3z F{x) = z 

Idem with Minf^'^. □ 



2.4 Examples of functions in the Max and Min classes 

The classes Max^J^ , Miri^J^ contain many fundamental non computable 
functions. To see that some functions are not in such classes, we shall use 
Theorem 15.51 below (the proof of which does not depend on any result of this 
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2.4-1 Kolmogorov and Chaitin-Levin program-size complexities 



Proposition 2.7 Let T> be (N, <). Kolmogorov and Chaitin-Levin program- 
size complexities Kf^, : N ^ N (resp.KY;*, H^* : S* ^ are in Miv}'jQ^\ 
Maxf]^^ (resp. m Min^^-^^ \ Maxfj^^). 



PROOF. That K, H belong to Min^J^ is a mere reformulation of the well- 
known fact that they are computably approximable from above, i.e. they are 
limits of decreasing computable sequences of total computable functions. That 
these total functions are not in Max^'^'^ is an obvious application of Theorem 
1531 below. □ 



2.4-2 Busy beaver 

Proposition 2.8 Let V be (N, <). Let BB : N N 6e the busy beaver func- 
tion, i.e. BB{n) is the maximum number of cells visited by the input head of 
a Turing machine with n + 1 states which halts with no input. 
Then BB e Max^^Z^ \ Minf^^ . 



PROOF. Observe that BB = max 66 where bb is the total computable func- 
tion such that bb{n, t) is the maximum among and the numbers of cells 
visited by Turing machines with + 1 states which halt in at most t steps. 
An obvious application of Theorem 15 . 51 below shows that BB is not in Min^^'^ . □ 

Remark 2.9 Variants of the busy beaver function can be very naturally de- 
fined with ranges over various types of data structures. For instance, finite 
graphs relative to the inclusion or embedding ordering. 

2.4-3 Cardinality of finite computably enumerable sets 
The following example is completely investigated in p[8] . 
Proposition 2.10 Let V be (N, <). Let cardRE : N ^ N 6e such that 



cardRE{n) 



{card{Wn) ifWn is finite 
undefined otherwise 



where card{Wn) is the number of elements of the computably enumerable set 
Wn with code n. 

Then cardRE e Max^^-^^ \ Minf^^ . 
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PROOF. Observe that cardRE = max h where h{n, t) is total computable 
and counts the number of elements of Wn obtained after t computation steps. 
The domain of the partial function cardRE is known to be S2 complete, hence 
not A U^. Applying Theorem 15.51 below, we see that cardRE cannot be in 

2.4-4 Interacting finite sets with a fixed computably enumerable set 
If X, r C N, let's denote X - F and X \ F the sets 
X-Y = {x-y: xeXAyeYAx>y},X\Y = {z: zeXAz^Y} 

Proposition 2.11 Let V be be the family P<lj(N) of finite subsets ofN, or- 
dered by set inclusion. If A (I'M is a fixed computably enumerable set which is 
non computable then 

i. the maps X t-^ X n A and X ^ X - A are in Max'^^'^ \ Min^]^'^. 
li. the map X ^ X\A is in Min^^^ \ Maxp]^^. 

PROOF. Let A = (p(N) where : N ^ N is total computable. Define total 
computable maps /, (7, /i : P x N ^ such that 

/(X, t)=Xn (/.({O, t}) g{X, t)=X- v;({0, t}) 
MX,t) =X\y.({0,...,t}) 

It is easy to see that X r\ A = (max-^/)(X) and X — A = {max^g){X) and 
X\A= {min^h){X) . □ 

2.4.5 Quotients of regular languages by a fixed computably enumerable lan- 
guage 

We now come to a very different example. 

The family Reg of regular languages over alphabet S can be defined by regular 
expressions which are words in the alphabet S obtained by enriching S with 
symbols^+, *,-,(,). 

Let C : — > Reg be the surjective map such that, if u is a regular expression 
then ({u) is the associated regular language, else ({u) = 0. 
Since equality of regular languages is decidable, there exists a computable map 
?7 : N — >• S* such that p = ( o rj : N ^ Reg is bijective. 

Using decidability of inclusion of regular languages, we see that {Reg, C,p) is 
a computable partially ordered set in the sense of Definition 12. 3[ 
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It is known that, if L is a regular language and M C E* is any language (even 
non computable) then 

M-^L = {uei:* -.Bv e M vue L} 

is always regular and M~^L = M'~^L for some finite subset M' C M. Recall 
the core of the easy proof: if L is the set of words leading from state go to a 
final state of automaton A and if the words in M lead from state go to the 
states in X, then M~^L is the set of words leading from a state in X to a final 
state. 

Proposition 2.12 Let M C Y]* be a fixed computably enumerable language 
which is non computable. Let Fm '■ Reg — > Reg be such that Fm{L) = M~^L. 
Then Fm is in Max^^^^^^ \ Miup'^^'^^'^^ . 



PROOF. Let M = (p{N) where : N ^ S* is a total computable function. 
Observe that Fm = max^^^ Jm where /a/ : Reg x N ^ Reg is such that 

fMiL,t) = i^{{0,...,t})-'L 

Observe that M is computable with oracle F since -u G M if and only if 
M~^{u} = {A}. Since M is not computable, F cannot be computable. Using 
Theorem 15.51 point 1 (and the fact that F is total), we see that F is not in 



Using the above surjection ( : Tj* ^ Reg , one can reformulate the above result 
in terms of a partial computable preordering on words quite different of the 
usual ones. This necessitates a straightforward extension to preorderings of 
the material about the Max and Min classes. 

Let fj, : Reg A* be the map which associates to a regular language L the 
regular expression (obtained via some fixed algorithm) describing its minimal 
automaton. Observe that C is a retraction of the injective map /i, i.e. ( o fi is 
the identity map on Reg. 

Proposition 2.13 Let T) be S* with the following computable preordering: 

u ^ ({u) C ((t>) 

Let M C S* 6e a fixed computably enumerable language which is non recucom- 
putablersive. Then the map u i— ^ ^{M~^i^{u)) (which maps a regular expression 
for L to one for M'^L) zs zn Max'^2^ \ Min^]^^ . 
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PROOF. Let F, / be as in the proof of Proposition 12. 12[ Since (o fi = Idjieg, 
we see that F = ^ o F o ( makes the following diagram commute: 

Reg > Reg 

C C 

t* — ^ s* 

which allows to transfer the results of Proposition 12.121 □ 
2.4-6 Noetherian or well-founded orderings 

Suppose T) is Noetherian (resp. well-founded) and let / : X x N ^ Z^. If 
t f{x,t) is monotone increasing (resp. decreasing) then it is necessarily 
eventually constant. In that case, the considered notion of approximation from 
below (resp. from above) coincides with monotone approximation. 
Fix n > 1. An important case is the noetherian set {V, C) of ideals in the ring 
of n-variables polynomials with real algebraic coefficients (this last hypothesis 
insures that V is countable with a computable ordering). 

2.5 Normalized representations 

It sometimes proves useful to normalize the / in max^ /. 

Proposition 2.14 Let H be a basic set and T> = {D,<,p) be a computable 
ordered set. 

1. Every F G Max^'^^ is of the form F = ma.x^ f for some partial com- 
putable / : X X N — > monotone increasing in its second argument, such 
that dom{f) = Z x N where Z is some S° subset of D. 

2. If F E Max^~^^ has domain then one can suppose Z = dom{F). 



PROOF. 1. Let : X X N — s> -D be partial computable, monotone increasing 
in its second argument, such that F = max^ g. Let Z = {x : 3t (x, t) G 
dom{g)} be the first projection of dom{g). Let 6 : H ^ D he the partial 
computable function with domain Z such that ^(x) is the value first obtained 
in {g(s,t) : t G N} by dovetailing over computations of g{s,0), g{s, 1), .... Let 
also 

'^x,* = {fl'(x, u) : u <t A g{x, u) halts in < t steps} 

and define / with domain Z x N such that /(x, t) is the greatest element of 
{^(x)}UA.,i 
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2. Observe that Z necessarily contains dom{F). If dom{F) is then f = f \ 
{dom{F) X N) is also partial computable and max"^ / = max-'' /. □ 



3 Kolmogorov complexities K^^^, 

Kolmogorov complexity theory goes through with the Max^^'^ and Minf,]^'^ 
classes with no difficulty. 

First, we recall Kolmogorov complexity over elements of T>. 

3. 1 Kolmogorov complexity 

Classical Kolmogorov complexity for elements in D is defined as follows (cf. 
Kolmogorov, 1965 [T^, or Li & Vitanyi [15], Downey & Hirschfeldt [6j, Gacs 
yiOj or Shen pj). 

Definition 3.1 Let (f : 2* ^ D. We denote : D ^ N the partial function 
with domain range{ip) such that 

K^{d) = min{|p| : (p{p) = d} 

I.e., considering words in 2* as programs, K^{d) is the shortest length of a 
program p mapped onto d hy (p. 

Theorem 3.2 (Invariance theorem, Kolmogorov, 1965 |11] ) Let X he 

a basic space and T> = {D, <,p : N ^ D) be a computable partially ordered 
set. When ip varies in the family PR^ of partial computable functions 
2* — i> D, there is a least K^^, up to an additive constant: 

3ip G PR^'^^ yip e PR^'^^ <ct 

Such if's are said to be optimal in PR^*^^. 

Definition 3.3 Kolmogorov complexity : D ^ N is K^ where (p is some 
fixed optimal function in PR^ . Thus, is defined up to an additive 
constant. 

Of course, and are related. 
Proposition 3.4 o p =,t K^ . 

PROOF. Since PR^'^^ = {p o : ^ e PR"^'^^^} and K.^{n) = Kpo^{p{n)) 
for all ip G PR^*^^, we see that if ip is optimal in PR^*^^ then pop is optimal 
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in PR"^*^^. □ 



We also observe the following simple fact: 

Proposition 3.5 suy){K^ [d) : d G X} = +00 for every infinite X (1 D. 

PROOF. The result is well-known for and it transfers to using Propo- 
sition [331 □ 

3.2 Enumeration theorem for Max^]^^ 

The classical enumeration theorem for partial computable functions goes through 
the max operator, leading to an enumeration of Max^~j^^ . First, we recall a 
folklore result on enumeration of monotone partial computable functions. 

Proposition 3.6 Let be a basic set and V = {D,<,p) be a computable 
ordered set. Let p/^^x^^^^.T ^/^g family of partial computable functions X x 
N — > D which are monotone increasing in their last argument. There exists a 
partial computable function ip: NxUxN-^D such that 

where : X x N ^ -D denotes the function (x, t) \—>- ip{n, x, t). 



PROOF. Let 0:NxXxN^Dbea partial computable function which 
enumerates the family pp^x^^^* Qf partial computable functions X x N ^ D, 
i.e, 

{0„ : n G N} = pp^xN-i^ 
We modify (j) to ip so as to get an enumeration of pp^xN-^D.T^ Consider an 
injective computable enumeration (n,, Xj, tj, (ij)i6N of the graph of 0. Let 

Z = {{ui, Xj, ti, di) -.'ij < i {rij = Hi A Xj = Xi A tj <ti ^ dj < di)} 

Let ip: NxUxN^Dhe the partial computable function with graph Z. It is 
clear that ip is monotone increasing in its last argument, so that so are all ipnS. 
Also, if (pn is monotone increasing in its last argument then {n} x graph{(pn) 
is included in Z, so that ipn = 4>n- Thus, the ipnS enumerate ppXxN-»_D,T^ □ 

Theorem 3.7 (Enumeration theorem for Afaxp^^) Let H be a basic set 
and V = {D,<,p) be a computable ordered set. There exists a function E : 
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N X X ^ D m Max%^^^ such that 

{E„ : n e N} = Maxf^'^ 
where : X — > denotes the function satisfying £^„(x) = E{n, x). 



PROOF. Let ip: NxUxN^Dhea partial computable function which 
enumerates pR^x^^D,-\_ E : N x X ^ D he such that = max^ ipn for 
all n. For any F : X — > D in Max^]^^ there exists n such that F — max^-^^. 
We then have 



X G dom{F) ^ {'?/'n(x, i) : t s.t. '?/'n(x, t) is defined} is finite non empty 

<^4> {ip{n, x,t) : t s.t. ip{n, x, t) is defined} is finite non empty 
<^ (n, x) e dom{E) 
X e dom{En) 

F(x) = greatest element of {'?/'„(x,/:) : t s.t. ipn{^,t) is defined} 
= greatest element of {ip{n, x,t) :t s.t. ip{n, x, is defined} 

= E{n, x) 
= En{x) 

Which proves that E enumerates Max^'^^. □ 



3.3 Kolmogorov complexity and K^-^ 



The invariance theorem extends easily to Max^£*^, leading to Kolmogorov 
complexity :D^N. 

Theorem 3.8 (Invariance theorem for Max^j^^) Let IL be a basic space 
and T> — {D, <, p : N ^ D) be a computable partially ordered set. When F 
varies in the family Max^£^^ there is a least Kp, up to an additive constant: 

3U e Maxf^^ VF e Max^'^^ Ku <ct Kp 



Such U 's are said to be optimal in Max^j^^ 



PROOF. The usual proof works. Let F : N x 2* ^ D in Max%^*^'^ be an 
enumeration of Max'j^^^. Define U : 2* ^ D such that f/(0"lj9) = E{n,p) 
and U (q) is undefined if q is not of the form 0"lp for some n G N and p G 2*. 
If F G Maxf^'^ and F = K then 
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Kpid) = mm{\p\ : F(p) = d} 

= min{|p| : E{n,p) = d} 

= min{|p| : f/(0"lp) = d} 

= min{|0"lp| : f/(0"lp) = d} - n - 1 

> min{|q| : U{q) = d} — n — 1 

= Ku{d)-n-l 

□ 

Definition 3.9 Kolmogorov complexity K^^^ is defined up to an additive con- 
stant as any Ku where U is optimal in Max^j^'^ . 

Kolmogorov complexity K^^^ is where V is the reverse order ofV. 



4 Main theorems: comparing K, K^,^., K'^^^, K'^' 
4-1 The <ct hierarchy theorem 

The main motivation of this section is to compare the Kolmogorov complexi- 
ties 

Comparisons of K^^, -^mm turn out to be a particular application of 

more general results dealing with both K'^^ and i^^m complexities relative 
to two computable orders Vst = {D,<st,p) and V^k = {D,<wk,p) on the 
same set D, the strong one <st being an extension of the weak one <wk- A 
question with naturally arises when considering for instance the prefix and 
lexicographic orders on S*. 

In the case of N with the natural order or of S* with the prefix order, the 
inequalities K'^ <ct <ct were obtained (modulo Proposition 12.51) 

for the prefix version H°° Becher & Figueira & Nies & Picci, 2005 [2J, 
We state our results as three theorems, the proofs of which are given in §4.51 
to QUI 

Theorem 4.1 (1st hierarchy theorem) LetV = {D, <,p) be a computable 
ordered set. 

1. <ct inf (K"^^^, 

2. K^^^, K^j^j^ are <ct smaller than but not simultaneously much smaller: 
Theorem 4.2 (2d hierarchy theorem) 

1. If {D,<) contains arbitrarily large finite chains then and K^^^ are 
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<ct incomparable and both are <ct smaller than . 
In fact, a much stronger property holds: 

i. is not majorized by a computable function of K^^^, 
a. is not majorized by a computable function of K^^, 
Hi. -ft'^ax ^■^ majorized by a computable function of K^-^, 
iv. -ft'mm '^^^ majorized by a computable function of K^^, 

1. e., for any total computable function a : N ^ N, the following sets are 
infinite 

{d e D : > c^iKZnid))} , {d e D : K^{d) > a{KZn{d))} 

{d e D : KZM > a{KZM)} , {d & D : {d) > a{KZ,M)} 

2. If {D,<) does not contain arbitrarily large finite chains then 

k'^ — K'^ — 

^min ct J^max ct 

Theorem 4.3 (3d hierarchy theorem) Let Vgt = {D,<st,p) and Vy,k = 
{D, <wki p) be two computable orders on the same set D ("wk" and "st" stand 
for "weak" and "strong") such that <st is an extension of <wk- 
1. Let (*) be the following condition 

{*) For all k there exists a strong chain with k elements which is a weak 
antichain. 

//(*) holds then <et and K^f^ <ct^i^™t- 

In fact, a much stronger property holds: 'm.i{K^^^, K'^^) is not majorized by a 
computable function of K'^^ or K'^f^. I.e., for any total computable function 
a : N — > N, the following sets are infinite 



{dED: inf«-(d),ir^t(rf)) > "KU^))} 

{deD: miiK^M. K^^id)) > a{Klf^{d))} 
2. Let {**) be the following condition (which is an effective version, tailored 
for infinite computations, of the negation of {*), cf. 



[**) There exists k such that for every partial computable f : 2* x N ^ D 
which is monotone increasing in its second argument relative to the strong 
order <st there exist partial computable functions fi, fk : 2* x N ^ D 
which are monotone increasing in their second argument relative to the 
weak order K^k such that 

{/(p,t):tGN}= U {/,(p,t):tGN} 
j=i, 



// (**) holds then K^^ and =ct K^^- 
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Corollary 4.4 Let Tj be a finite or infinite countable alphabet, let <i, < be 
computable orders on S such that <i is partial but non trivial and < is a total 
extension of <i. Consider on E* the following orders: the prefix order <prefix, 
the lexicographic orders <iexicoi and <iexico associated to <i and <. Then 

IfT^ prefix ^ 7^-^<!eiicoi T/^<lexico t/D prefix ^ jj-'^ <lexicox ^ T/^<lexico 

PROOF. Let a, 6, c, (i G S be such that a <ih and c < d but c <jti d. Since 
< extends <i, c and d are <i incomparable. Observe that {a"6 : n G N} is an 
infinite increasing chain for <iexicoi and an antichain for the prefix order. Also, 
{c^d : n G N} is an infinite increasing chain for <iexico and an antichain for 
the <iexicoi order. This gives condition (*) relative to the pairs {<prefix, <iexicoi) 
and {<iexicoi,<iexico) of orders on E*. □ 

4-2 (*) is an effective version of the negation of {**) 

Recall Dilworth's theorem. 

Theorem 4.5 (Dilworth, 1950 [5j) Let V = {D, <) be an ordered set and 
k eN. If every antichain in D has at most k elements then D is the union of 
k chains. 

Dilworth's theorem leads to an equivalent form (f) of (*) and condition (**) 
appears as an effective version of ~^{\), tailored for infinite computations. 

Proposition 4.6 Let T>st = {D, <st) and = {D, <wk) be two orders on 
the same set D such that <st is an extension of <wk- 
Then (*) is equivalent to the following condition (f) ; 

(t) For all k there exists a finite strong chain X which is not the union of k 
weak chains 

PROOF. (*) ^ (f). Apply (*) with k + 1 and observe that a weak antichain 
with k + 1 elements cannot be the union of k weak chains. 

^ ~'(t)- Let k be an integer which contradicts (*). Then, in any strong 
chain, any weak antichain has < k elements. Apply Dilworth's theorem to get 

-(t). □ 

Remark 4.7 1. Clearly {**) =^ ~'(t)- We do not know whether the converse 
implication holds or not. The problem is that the proof of Dilworth's theorem 
is not incremental as we now detail. Let XU{d} be a strong chain with d >st x 
for all X E X and such that every weak antichain included in X has at most k 
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elements. If X is covered by k weak chains Ci, ...,Ck then d may he incompa- 
rable to the top elements of all these k chains. Thus, though X U {d} is also 
the union of k weak chains, such chains may he quite different from the Cj 's. 
Condition (**) (as contrasted to ), does insure such an incremental char- 
acter. 

2. In case <wk has a smallest element d, condition {**) is equivalent to the 
analog condition in which functions f,fi,...,fk are replaced by total computable 
g,gi,...,gk. This can be seen by defining g,gi,...,gk from f,fi,...,fkas follows 

g{p,0)^d , g{p,t+l)^ 
and the same with gi, g^ from fi, f^. 
4-3 K'^x-i ^min ^'^^ '^^^ simultaneously much smaller than 

Lemma 4.8 Let T> = {D, <, p) be a computable ordered set. Let c : 2* x 2* — 
2* be a total computable injective map and let J : N x N ^ N and M e N 6e 
such that \c{p,q)\ < J{\p\, \q\) + M for allp,q e 2*. Then 

<ct J{K^in^ ^Zax) 

In particular (with the special convention log(O) = 0^, 

<ct (i^Lx + log(i^^J) + {KZn + log(i^^.J) 

PROOF. Let U,V : 2* ^ D he optimal in Maxf£''^ and Mirv^*^^ , i.e. 
^max = and -ft'mm = ■ Let /, (yf : 2* X N — ^ D be partial computable, 
respectively monotone increasing and decreasing with respect to their 2d ar- 
gument such that U = max''^ / and V = min^ g. 

Define a partial computable function ip : 2* —>■ D as follows: 

• If r is not in range{c) then ip{r) is undefined. Else, from input r, get p and 
q such that c{p, q) = r. 

• Dovetail computations of the f{p, t)'s and g{q, t)'s for t = 0, 1, 2, .... 

• If and when there are t',t" such that fip,t') and g{q,t") are both defined 
and have the same value then output their common value and halt. 

By the invariance theorem, there is a constant N such that < K^p + A^. 
Let d E D and let p, q be shortest programs such that U (p) = V{q) = d, i.e. 
KZ^xid) = \p\ and K^nid) = \q\. 

Observe that, whenever f{p, t') and g{q, t") are both defined, we have /(p, t') < 



f{p,t) if f{p,t) converges in <t steps 
g{p,t) otherwise 
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d < g{p, t"). Also, since U{p) = max^{/(p, t) : t G N} and V{q) = min^ {g{q, t) 
t G N}, there are t' ,t" such that f{p,t') = d = g{q,t"). Therefore, {p{c{p,q)) 
hahs and outputs d. Therefore 

K^{d) < K^id) + N< |c(p, g)| + iV < JiKZM, ^Z^M) + N 
The last assertion of the Lemma is obtained with the injective map 



c{p, q) = < 



0\B^^i\p\)\lBin{\p\)pq if \p\ < \q\ 
l\BMM)\QBin{\q\)pq if \p\ > \q\ 



(where Bin{x) denotes the binary representation of x) since 

|c(p,g)| = H + |g|+2[log(min(|p|,|g|))J+3< (b|+log(b|)) + (|g|+log(|g|)) + 3 



□ 



4 ■ 4 K'^^x . KZin and the jump 



Proposition 4.9 1. Let X be a basic space. All functions in Max^~^^ and 
Minf,]^^ are partial computable in 0'. In particular, is recurcomputablesive 
in 0'. 

2. -ft'mjn and are computable in 0'. 



PROOF. 1. Proposition 12.61 insures that any F : H ^ V in Max^]^'^ or 
Min^'^'^ has S'j' A graph. Therefore two calls to oracle 0' suffice to decide 
F(x) = d. 

2. Let po,pi, ... be a length increasing enumeration of 2* and let U : 2* ^ T> 
be optimal in Maxp^-^, i.e. Ku = Kmax- can compute K^^^{d) with 
oracle 0' as follows: 

i. Using oracle 0', test successive equalities U{p) = d (cf. Point 1) for pro- 
grams p = Po,pi, . . .. 

ii. When such an equality holds (which necessarily does happen) then output 
IpI and halt. 

Idem with Kj^,„. □ 



21 



4-5 Proof of Theorem 



4 .11 (1st hierarchy theorem) 



1. Large inequality K^'^^ 'mi{K^^^^ K^^) . Point 1 of Proposition 14.91 in- 
sures that Max^^ and Min^^ are included in PBf' . Therefore K^'^^ <^^^ ^min 
and K'^''^ <et KZ^., i.e. K'^''^ <ct mf {K^n^K^.^. 

Strict inequality <ct inf(K,^j„, K^^). Point 2 of Proposition 14.91 insures 

that inf (K^j^, K^^^) is computable in 0'. Now, the well-known fact that if 
il) =ct then if) is not computable relativizes: if if) =ct then %jj is not 

computable in 0'. In particular, inf K^^) ■ 

2. This is the contents of Lemma [4.81 □ 

4.6 Inequalities K'^^ <et i^^S and K^f^ <^t 

The following result is straightforward. 

Proposition 4.10 With the notations of Theorem \4.3\ 

min — ct ^ mm ; max — ct max 



PROOF. Since <st extends K^k, every partial computable function 2* — > D 
which is monotone increasing in its second argument relative to <wk is also 
monotone increasing relative to <st- So that Max^fl" C Max^"^. Which yields 

max — ct ^'-max' 



4-7 If (*) holds: proof of Point 1 of Theorem \4.3\ (3rd hierarchy theorem) 
We use the notations of Theorem 14.31 

Lemma 4.11 Let a : N N be a total computable function. 
If condition {*) holds then there exists total functions F,G : N ^ D respec- 
tively in Max^J^'* and Min^J^'* and a constant c such that, for all i G N, 

i^Lt(^W)>«« , ir^-(F«)>«(0 , K^,iFii))<\ogi{)+c 
K^i{G{i)) > ail) , K^:i{G{i)) > a{i) , Kltn{G{i)) <\og{i) + c 



PROOF. 1. Since (*) holds, for all i G N, there exists a finite strong chain 
with 2"'^*)+^ elements which is a weak antichain. Dovetailing over subsets of D 
with 2"'^*^"'"^ elements, one can effectively find such a strong chain Zj. Thus, 



22 



there exists a total computable function a : N x N ^ D such that, for all 
i G N, 

• a{i, 0) <st (t{i, 1) <st ... <st cr{t, 2"W+i - 1) 

• Zi = {a{i,j) : j = 0, 2"*^*^+-'^ — 1} is a weak antichain. 

2. Let / and g are partial computable functions 2* x N ^ D such that U = 
max / and V = min '"*(yf are optimal in Maxp^ and Miupj^ i.e. 
i^c; = i^'^™* and Kv = i^^t- 

We observe that inequalities K^^!^{F{i)) > a{i) and K^^^{F{i)) > a{i) are 
equivalent to disequalities U{j)) ^ F{i) and V{j>) ^ F{i) for every p such that 
\p\ < a{i). 

We define F, G : N ^ D as F = max^** £ and F = min^"' ^ for some total 
computable £ : N x N ^ £>. Let 



Xp = {f{pit) ■ t s.t. f{p,t) converges} 
yp = {g{p,t) '■ t s.t. g{p,t) converges} 

Xp = {/(p, t') E Zi : t' < t and f{p, t') converges in < t steps} 
= {9{P^ t') & Zi : t' < t and g{p, t') converges in < t steps} 

Since Zj is a weak antichain and Xp, Yp are weak chains, each one of the sets 
Zi n Xp and ZidYp has at most one element. Thus, [j\p\<a(i){^p U ^) has at 
most 2(2°(*) - 1) = 2"(*)+i - 2 elements in Z^. Since Zi has 2"(*)+i elements 
and the cr(i,j)'s are in Zj, the following definition makes sense: 

i{i,t) = a{i,j) where j is least such that a{i,j) ^ |J (X* U Fp) 

|p|<a(«) 

Now, F{i) = (max^^'£)(i) and G{i) = (min^"*£)(z) are of the form i{i,t'i) and 
i{i,ti) for some hence they are not in [j\p\<a{i){^p U particular, 

since U{p) = max-'^^'^Xp is in Xp and V{p) = mm^'"''Yp is in Yp, we see that 
F{i) and G'(i) are not in {U{p),V{p)} for any \p\ < a{i). Which proves that 
K^^^Fit)), K^iFit)), Kl^i{G{i)) and K^:i{G{i)) are all > a{i). 

3. Since F G Maa;^^'^"', the invariance theorem insures that K'^^ <ct Kp. 
Now, KF{F{i)) <ct log(2), hence the inequality K^%{F{i)) < log(i) +c for 
some constant c. Idem with K^f^{G{i)). □ 



Proof of Point 1 of Theorem 14.31 Apply Lemma 14.111 with a' such that 
a' is monotone increasing and a'{i) > ma.x{a{i) , i) for all i. Since a'{i) tends 
to +00 with i, so does F{i). Let iq be such that log(i) + c < i for alH > io. 
Since a' is increasing and a' > a, for all i > io we have 

> > «'(Llog(0 + cj) > a'{K±{Fm > a{K^^{Fm 
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Similarly, we have > a{K^%{Fm and K^i{G{{)) > a{K^l{Gm 

and kZ^{G{z)) > a{K^l,{Gm- 

Finally, observe that {F{i) : i > ig} and {G{i) : i > i^} are infinite. Which 
concludes the proof of Point 1 of Theorem I4.3[ □ 



4-8 Proof of Point 1 of Theorem ^.^| (2d hierarchy theorem) 



Comparing to and K^^^. 

Let <si be < and <^k be the empty order. Then 



max max ' min min i max min 

The condition (in Point 1 of Theorem 14. 2p that P contains arbitrarily large 
chains insures condition (*) about <st and <wk- Thus, we can apply (the just 
proved) Point 1 of Theorem 14.31 This gives properties i and ii of Point 1 of 
Theorem 1121 

Comparing K^,^ and K^^^. 

We shall prove properties iii and iv of Point 1 of Theorem 14. 21 using properties 

i and ii and also Lemma 14. 8[ 

Applying Lemma SSI let c be such that, 

(t) < 2 {KZ,, + Kl,J + c 

Property iii applied to a'{i) = 2 {a{i) + i) + c insures that the set 

X = {d: K^id) > 2 (aiKZM) + K^nid)) + c} 
is infinite. Now, using (f), we see that, for d G X, 

2 {a{KZM) + KZnid)) + c < ir^(d) < 2 {KZ^Ad) + K^nid)) + c 
hence K^ixid) > a{KZn{d)). Which proves iii. The proof of iv is similar. □ 

4-9 If {**) holds: proof of Point 2 of Theorem \4.3\ (3d hierarchy theorem) 



Lemma 4.12 With the notations of Theorem \4.3\ if condition {**) holds th 



en 



min — ct ^^min i ^^max — ct ^^max 

PROOF. I. Let k be as in (**). Let U,t be optimal in Maxp| and / : 2*xN ^ 
D be partial computable such that max-''"' / = Ust- 

Due to Proposition 12.141 we can suppose that / has domain of the form Z x N 
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and is monotone increasing in its second argument, with respect to the strong 
order. 

Applying (**) to /, we get k partial computable functions /i, /fc, monotone 
increasing in their second argument, with respect to the weak order, such that 

(tt) {/(p,t):tGN}= U {/,(p,t):tGN} 

i=l,...,k 



Define 51 : 2* x N — > D such that 



fi{p, t) if q = 0^1'' *p for some p and 1 < i < k 
undefined otherwise 



Clearly, g is partial computable and monotone increasing in its second argu- 
ment relative to the weak order <u,fc. 

If p G dom{Ust), then {f{p,t) : t G N} is finite and non empty. Let f{p,tp) 
be its <st greatest element. Condition (jj) insures that there exists i such that 
{5f(0*l'^"*p, t) : t G N} is finite and contains f{p,tp). Since g is <wk increasing 
in t, the set {^'(O'l''"'^, : t G N} is a weak chain. Since <st extends <wki 
f{p,tp) is necessarily its <wk greatest element. Thus, 

UM = f{p,tp) = {m8.x^'g){0n'-'p) 

This proves that, for all (i G -D, 

^maxi^) = least \p\ such that Ust{p) = d 

= least \p\ such that (max"''^(7)(0*l^^*p) = d for some i 
> least |g| — k such that (max'"'^5f)(g) = d 

~ ^raa.yPwk g{d) — k 

Since, by the invariance theorem, K^^^v^t.^ >ct K^^^, we get the desired 
inequality Kl^% >ct Kj^^. 

2. Considering the reverse orders, we get the inequality K^f^ >ct K^"^. □ 



Proof of Point 2 of Theorem 14.31 Straightforward from the above Lemma 
I4T2] and Proposition KTU[ □ 



4-10 Proof of Point 2 of Theorem \4.S\ (2d hierarchy theorem) 



As in §4.8^ let <st be < and <^fc be 0, so that 

max max i min min i max min 
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Suppose all chains in {D, <) have length < k. We shall prove condition (**) 
for the above orders <st and K^k- 

Let / : 2* X N — >■ Z) be partial computable, monotone increasing in its 2d 
argument for the strong order, i.e. for the < order. Compute f{p,t) for t = 
0,1,... to get the < k distinct elements of the chain {f{p,t) : t E N} (not 
necessarily in increasing order) and let fi{p) be the i-th element so obtained 
(if there is some). Then fo, fk : 2* ^ D are partial computable and 

{f{p,t) : t e N} = {Mp) : t s.t. Up) is defined} 

which insures condition (**). 

Applying Point 2 of Theorem 14.31 (proved above), we get =ct equalities which 
are exactly those of Point 2 of Theorem 14.21 □ 



5 Complementary results about the Max and Min classes 



In this section we further investigate the different Max and Min classes. The 
results do not involve as many technicalities as those of §11 



5. 1 Total functions in Max^'^J^ and Max^~^^ 



As a straightforward corollary of Point 2 of Proposition 12.141 we get the fol- 
lowing result. 

Theorem 5.1 The classes Max^J^ and Max^~^^ contain the same total 



functions: 



Maxf^^ r]D^ = MaxlZ^ H 



5.2 Comparing Max'f]^'^, Max|^^ and PR^'^'^, Rec^'^'^ 



Proposition 5.2 Let H be a basic set and T> = {D,<,p) be a computable 
ordered set. 

1. If < IS empty then PR^^'^ = Maxf]^'^ and Rec^'^'^ = Max^^ . 

2. If < is not empty then Max^J^ contains non computable total functions. 
In particular, PR^^^ C Max^'^'^ and Rec^^^ C Max^J^ (where C denotes 
strict inclusion) . 



3. Whatever be <, PR^^'^ is not included in Min^J^ U Max^^ . 
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PROOF. 1. Straightforward. 

2. Inclusions PR^^'^ C Maxf^^ and Rec^"*'^ C MaxjQ''^ are obvious. 
Suppose there exists comparable distinct elements a < b in D. Let Z be some 
computably enumerable non computable subset of X and let : N X be a 
total computable map with range Z. Define / : X x N ^ -D total computable, 
monotone increasing in t, such that 



a if X ^ {e{n) ■.n<t} 
b otherwise 



Then max / is total and (max/) ^{b) = Z and (max/) ^(a) = X \ Z. Since 
Z is not computable, max/ is not computable. Which proves Rec^^^ C 

3. First, we consider the case where (-D, <) has a minimal element d. Let 
7rf : X — »• Dhe the partial computable function with domain Z (as in Point 2 
of this proof) which is constant on Z with value d. We show that vrj is not in 
Max^g^. Suppose / : X x M — > D is total computable, monotone in its second 
argument, such that max-^ / = vrf . Since d is minimal in (max-^ f){^) = d 
if and only if Vt f{'^,t) = d. Thus, the computably enumerable set Z would 
be n^, hence computable, contradiction. 

We now consider the case where (-D, <) has no minimal element. Let 7 : D — > 
D be the total computable function which associates to each d & D the element 
p{kd) where Ud is the least k such that p{k) < d. Let (0)eGX be an enumeration 
of pji^^'^^D which is partial computable as a function $:XxXxN^D. 
We consider an enumeration {en, x„, dnjnen of the graph of $ and define a 
partial computable function : X — > P as follows: 



X 



7((i„) if n is least such that e^, = x^ = x 
undefined if there is no such n 



It is clear that, for every e, if 0e(e, t) is defined for some t then (p{e) is defined 
and ip{e) < 06(e,t). In particular, if 0e is total then <^(e) < (max-^ </)e)(e), 
hence ip 7^ max'^ (pe- Which proves that ip is not in Max^~^J^. 
Arguing with P"'^" we get some function in PR^^^ which is not in Min^J^ . 
Considering v^o; V^i ^ PR^'^^ such that ip^ ^ Max^J^ and v^i ^ Min^J^ and 
a computable bijection cr : Xx {0, 1} ^ X we get a partial computable function 
V9 : X ^ I) which is not in MaxjQ^ U MinjQ^ by setting v5(o-(x, 0)) = (po{x) 
and V9(cr(x, 1)) = (y9i(x). □ 



5.3 Post hierarchy and the Max/Min classes 



We keep notations of §2.31 
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Theorem 5.3 Let 'K be a basic set and V be a computable ordered set. 
1. Let D' be an initial segment of D (i.e. d' E D' /\ e < d' ^ e ^ D' ). 
Suppose D' is 11° and does not contain any strictly increasing infinite sequence 
d'Q < d[ < .... Then 

1. Every D' -valued function in Max^'^^ has A domain, 
a. Every D' -valued function in Max^J^ has domain. 

2. Let D' he a final segment of D (i.e. d' & D' A e > d' ^ e & D'). Suppose 
D' is Ti\ and does not contain any strictly increasing infinite sequence. Then 
i. Every D' -valued function in Max^'j^^^ has domain. 

a. Every D' -valued function in Max^J^ is total. 



PROOF. 1. Suppose that max^/ is valued. Since D' is an initial seg- 
ment and / can be supposed monotone increasing in its second argument, if 
(max-^/)(x) is defined then, for all t, /(x, t) is either undefined or in D' . 
Now, since D' has no infinite increasing sequence, the set {/(x, t) : t e 
N s.t. /(x, t) e D'} cannot be infinite. Thus, x e (iom(max^/) if and only 
if 

3t f{x,t) is defined A {f{x,t) is defined f{x,t) e D') 
In case / is total computable, then the above equivalence is simply 

X e dom{max^f) ^ Vt f{x,t) e D' 

2. Since D' is a final segment and / can be supposed monotone increasing 

in its second argument, if (max"'^ /)(x) is defined then, for all t large enough, 
/(x, t) is either undefined or in D'. Now, since D' has no infinite increasing 
sequence, the set {/(x, t) : t e N s.t. /(x, t) e D'} cannot be infinite. Thus, 

X e c?om(max^/) 44> 3t (/(x, t) is defined A /(x, t) e D') 

□ 



The next corollary is an application of the above theorem with the reverse of 
the following D's: 

• P is the natural order on Z and D' — N, 

• "D is the natural order on N or of the prefix order on E* and D' — D, 

Corollary 5.4 1. Every N-valued function in Min^~^^ (resp. Min^^) has 
E5 A n5 (resp. domain. 

2. Let V beN with the natural order or E* with the prefix partial order. Then 
every function in Mmp^-^ (resp. Min^J^) has E^ domain (resp. is total). 
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5-4 Max n Min classes 



Theorem 5.5 Let X &e a basic set and V — {D, <, p) be a computable ordered 
set. 

1. Every function F : ^ D in Maxji](^ fl Minjfpl^ is the restriction of a 
partial computable function H V to some A IlJ subset o/X. 

In particular, every total function in Max^^'^ fl Minjij^'^ is computable. 

2. Suppose T> has no maximal (resp. minimal) element. Then the restriction 
of any partial computable function X ^ V to any A subset of X is in 
Maxp-^^ (resp. Minf]^^). 

3. Suppose V has no maximal or minimal element. Then Max^~^^ fl Min^'^^ 
coincides with the family of restrictions of partial computable functions X — > "D 
to E° An° subsets o/X. 



PROOF. 1. Let F = max^/ = min g where f,g -.XxN D are partial 
computable and / (resp. g) is monotone increasing (resp. decreasing) in its 
second argument. Let's check that F(x) is defined if and only if 

(*) {3t', t" fix, t') = ^(x, t")) A (yu, V fix, u) < gix, v)) 

In fact, if Fix) is defined then 

Fix) = fix J') = gix,t") for some t',t", 

gix, u) < Fix) < fix, v) for all u, v such that gix, u), fix, v) are defined. 

Conversely, from (*) we see that, for u > t' and v > t", /(x, m) = /(x, t') = 
gix,t") — gix,v). Hence the finiteness of {fix,u) : u} and {gix,v) : v}. 
This proves that the domain of F is A H^. 

Let G : X V he the partial computable function defined as follows: 

Dovetail computations of /(x, 0), /(x, 1), . . . , gix, 0), gr(x, 1), . . . until we get 
t', t" such that fix, t'),gix, t") are both defined and equal. Output this com- 
mon value. 

Applying (*), if F(x) is defined, then so is G(x) and F(x) = G(x). Thus, F is 
the restriction of a partial computable function to some A set. 

2. Suppose there is no maximal element. Since the order < is computable, by 
dovetailing, one can define a total computable function ^ : D ^ D such that 
7((i) > d for all d E D. Let F : X — > D be partial computable and let Z C X 
be E? A n; definable: 

xeZ^i^t Rix, t)) A (Vt Six, t)) 
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where i?, S* C X x N are computable. Letting 7*^*) denote the t-th iterate of 7, 
we define / : X x N ^ D as follows: 



F(x) 



if F{x) converges in < t steps 

and {3t' < t i?(x,f)) A (Vf < t S{x,t')) 



^w(^F{x)) if F{x) converges in < t steps 

and 3t' < t -^S{x, t') 
undefined otherwise 



It is easy to check that max^ / is the restriction of F to Z. 
The assertion with Min^'^'^ is obtained with the order reverse to V. 
3. Straightforward from Points 1 and 2. □ 



Remark 5.6 Theorem \5.3\ shows that Points 2, 3 of the above theorem do not 
hold for general ordered sets T). 



6 Max^j^^^ and Min^^'^ and Kolmogorov complexity 



Since there is no computable enumeration of total computable functions, it 
seems a priori desperate to get an invariance theorem for the class Max^J^ . 
Nevertheless, there are important cases where such a result does hold. For 
instance, when D is N with its usual ordering. 

The purpose of this section is to characterize the orders T> such that an in- 
variance theorem holds for the class Maxj^^^ (resp. Minj^^^). 
First, we deal with the enumeration theorem. 



6.1 Max%l and the enumeration theorem 



Theorem 6.1 (Enumeration theorem for Max^J^) Let H be a basic set 
and V = {D, <,p) be a computable ordered set. The following conditions are 
equivalent: 

i. There exists a smallest element in T>. 

a. There exists a function £' : N x X — D m Max^^^^^ such that 

{K-neN} = MaxlZ^ 
where En : H ^ D denotes the function x 1-^ E{n, x). 
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PROOF, i =^ a. Let a e D be the smallest element of D. As in pl2l let 

ip: NxUxN-^Dhe partial computable monotone increasing in its last 
argument such that E = maxP ip is an enumeration of Max^~^'^ . Consider an 
injective computable enumeration (n,, Xj, tj, dijuz-^ of the graph of tp. Since a is 
the smallest element, we can define a toto/ computable function : NxXxN 
D as follows: 



X{n, X, t) = {di : i < t A rii = n A Xi = X A ti < t} 
ip{n, X, t) = greatest element of {a} U X{n, x, t) 

Suppose ipn is total, we show that max^ ipn = Taax^ ipn- Fix some x. Observe 
thjit {iJni^,t) : t G N} is {'(/'n(x,t) : t e N} or {a} U {^/'„(x,t) : t G N}. Thus, 
{'i/'n(x, t) : t G N} and {'?/'„(x, t) : t G N} are simultaneously finite or infinite, 
and when finite they have the same greatest element. Since ipn is total, this 
proves that (max-^ ■)/'„) (x) = (max-^ ?/'„)(x). Thus, every function in Maxj^J^ 
is of the form max^ ipn for some n. 

Set E = max^ 'il). Then E is in Max^f'^^ and the -En's enumerate Max^J^ . 

ii =^ i. We prove -^i =^ -lii. Suppose V has no minimum element. By dove- 
tailing one can define a total computable map j : D ^ D such that d ^ 'j{d) 
for all d. 

Let E = max^ g -.N xX ^ D where g: NxXxN—f-Dis total computable 
monotone increasing in its last argument. We define a total computable map 
f : —y D such that f ^ E^ for all n. Let ^ : N — X be some computable 
bijection. Set f{6{n)) = 'y{g{n,9{n),0)). Then 

g{n,e{n),0) ^ f{d{n)) and g{n,e{n),0) < {me.x^g){e{n)) = E^{d{n)) 

Thus, f{e{n)) ^ En{9{n)). Hence f ^ E^ for all n. □ 



6.2 Maxj^^^ and the invariance theorem 



If V contains a smallest element then the enumeration theorem of §6.11 allows 
to get an invariance result for the class Max^^^. 

Surprisingly, it turns out that an invariance result can be proved for partially 
ordered sets with no smallest element, hence which fail the enumeration the- 
orem. 

Also, in case the class Maxj^^'^ has optimal functions then they prove to be 
also optimal for the bigger class Max'^p^^ . 

Theorem 6.2 Let X be a basic space and V = {D,<,p : N ^ D) be a 
computable partially ordered set. Let (*) be the following condition on V : 
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(*) The set of minimal elements of D is finite and every element of D dom- 
inates a minimal element 



1. IfV satisfies {*) then 



i. Every function in Maxpjf has an extension (not necessarily total) in 
a. The invariance theorem holds for Max"^^^^ . 

Hi. Every U in Max^^^ which is optimal for Max^^^ is also optimal for 
the class Maxj^j^^. 

In particular, the Kolmogorov complexity associated to Max"^^^^ coin- 
cides (up to a constant) with that associated to Max^j^'^. 

2. IfV does not satisfy (*) then the invariance theorem fails for Maxj^^^ . 
Moreover, counterexamples can be taken in the class Rec^*^^ of total com- 
putable functions 2* T> : 

VG G Maxf,7^ 3F G Rec"^'^^ Kg tct Kp 



PROOF. 1. Suppose (*) holds and let M = {mo, ...,mk} be the set of min- 
imal elements. For i < k, let Di = {d & D : d > rrii}. Some of the Dj's 
may be finite, though not all of them (else D would be finite). Let i < k he 
such that Di is infinite for i < £ and finite for i < i < k. Since the Di are 
computable, for i < i, there exists a computable map pi : N ^ Di such that 
Vi = {Di, < n {Di X Di), Pi) is a computable partially ordered set. 

A. Since Di has a smallest element, namely mj, Max^^^ satisfies the enumer- 
ation theorem (cf. Theorem 16. ip . The proof of Theorem 13.81 applies, insuring 
that Max^g^ satisfies the invariance theorem. 

Let : 2* X N — >■ be total computable such that max-^' gi = Ui : 2* ^ Di 
is optimal in Max^l^. 

Let's check that Ui is also optimal in Maxpjj. Let Fi G Maxpj^ and Fi = 
max-^* fi where /j : 2* x N ^ is partial computable monotone increasing in 
its second argument and has domain x N where Zi C 2* is computably enu- 
merable (cf. Proposition 12. 141) . Define a total computable map fi:2*xN—>-Di 
such that 

{fi{p, t) if p is seen to be in Zi in < t steps 
rrii otherwise 

Set Fi = max-^* fi. If p G Z then fi{p,t) = fi{p,t) for t large enough, so that 
Fi{p) = (max^'/i)(p) = {max'^' fi){p) = Fi{p). Thus, Fi extends Fi. Which 
trivially yields < Kp^. Since Fi G Max^g^, we have Ku- <ct K^. Hence 

B. We group the functions gi and Ui of Point A to get a total computable 
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g : 2* X N ^ D and the associated U = max^ g in Max^g^. Define g as 
follows: 



gi{p, t) if q is of the form 0*lp with i < p G 2* 
mo otherwise 



For z < £ and d E Di, we have 

K(7(c/) < KuXd) + i + 1 for alH < £ and d E Di 

Suppose F is in Max^^ is of the form F = max-^ / where f : 2* x N ^ D is 
partial computable. For i < i, let Fi = max-^' /j where /j : 2* — Di is such 
that 

{f{p,t) if f{p,t) is defined and is in Di 
undefined otherwise 

Clearly, Fi is the restriction of F to F~^{Dj). Thus, Kpid) = KpXd) for all 
d e Di. 

Since Fi G Maxpjj and Ui is optimal in Maxp|j, there exists q such that 
Kij. < Kp- + Cj. Thus, for d E Di, we have 

<KuXd) + i + l< KpXd) + Ci + i + 1 < Kpid) + q + i + 1 

Let a be the maximum value of Kp on the finite set [Ji^j^i^ Dj. Set c = 
sup({ci + i + l:i<i}U {a}). Then Kuid) < Kp^d) + c for allrf G D. Which 
proves that U , which is in Max^g^, is optimal in Maxp^. 
C. If V in Maxpg^-^ is optimal for Max'j^^^ then i^'y ^ct -^(7 (where [/ is as 
in B). Since U is is optimal in Max^^^, so is V . 

2. Suppose (*) fails. Observe that, for every finite subset Z of D, there exists 
d such that z ^ d for all z E Z. Else, the set of minimal elements of Z would 
satisfy (*). 

Let D^^ be the set of finite sequences of elements of D. By dovetailing we can 
define a total computable function 7 : D"^"^ D such that, for all {do, dk) E 
D<^, 

di ^ 7(^0) dk) for all i = ...,k 

Let 6 : N — > 2* be such that 6(0) is the empty word and h{2n + 1) = 6(n)0 
and h{2n + 2) = h{n)l. As is well known (cf. Li & Vitanyi [15], p. 12), 6 is a 
total computable bijection which is length increasing: i < j ^ |fe(z)| < \b{j)\, 
so that 

{fei : i < 2*^ -2} = {g G 2* : |g| < k} 

Let G = max-'' g where g : 2* x 'N ^ D is total computable. Define a total 
computable F : 2* ^ V as follows: 

Fip)=7{9{bo,0),...,g{b,2M-„0)) 
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By definition of F, we see tliat g{q,0) ^ F{p) for all q such that |g| < 2\p\. 
In particular, if |g| < 2\p\ and G{q) is defined, since g{q,0) < G{q) we 
have F{p) ^ G{q). This insures that Kg{F{p)) > 2\p\. Since, obviously, 
Kf{F{p)) < \p\, we get Kg{F{p)) > Kf{F{p)) + \p\. Which proves that Kg- 
Kp takes arbitrarily large values, hence G cannot be optimal in Max^^^. 
Since F is total computable, this also proves the last assertion of Point 2. □ 



Applying Theorem 16.21 to N and Z with the natural orderings, we get the 
following result. It is interesting to compare Point 1 with Proposition 12. 5[ 

Corollary 6.3 1. The invariance theorem holds for the class Max^^^. More- 
over, optimal functions in Max]^^~^^ are optimal for the class Maxp^^. In 
particular, the Kolmogorov complexity associated to Max]^^^ coincides (up 
to a constant) with that associated to Maxj^j^^ . 

2. The invariance theorem fails for the classes Min^^^, Maxj^^^^ and Minj^^ 

Since Reg with the inclusion ordering (cf. §2.4.51) has a minimum and a maxi- 
mum element (namely and S), we get: 

Corollary 6.4 The invariance theorem holds for the classes Max^^^^^ and 
Miri]i^^^^ . In particular, the associated Kolmogorov complexities coincide (up 
to a constant) with those associated to Maxp^^*^^ and Min^^^^^^ . 
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